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(57) Abstract 

A digital telemedicine or other remotely-controlled imaging system 
for enabling an operator at a local site (14) to analyze images (70) 
received in digital form from an auto-focus microscope located at a 
remote site (12). The system (10) includes a bandwidth optimization 
system and a virtual focus system with a graphic user interface (50). The 
bandwidth optimization system enables an operator to conveniently select 
the resolution of images to be observed, and to enhance the resolution 
of portions of images currently under observation. The computational 
burden at the remote site and transmission requirements between the sites 
are thereby reduced. The virtual focus system enables an operator to 
emulate direct and continuous control over the microscope focus, The 
focus system is convenient to use and enables the operator to effectively 
observe the specimen at a number of different focal planes. 
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DIGITAL TELEPATHOLOGY IMAGING SYSTEM WITH 
BANDWIDTH OPTIMIZATION AND VIRTUAL FOCUS 
CONTROL FUNCTIONS 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates generally to remotely-controlled imaging systems. 
In particular, the present invention is a remotely-controlled microscope imaging system 
for telepathology having programmed bandwidth optimization and virtual focus control 
functions. 

Description of the Related Art 

Pathologists routinely assist surgeons by analyzing and providing diagnostic 
opinions on frozen sections of tissue samples removed from patients during surgery. 
Frozen sections are small tissue specimens which are quick-frozen, sliced, treated with 
dyes and placed on slides. The slides are then analyzed through a microscope by the 
pathologists. The diagnoses provided by the pathologists are used by the surgeons in the 
course of determining the nature and extent of further surgical procedures. For example, 
pathologists often analyze tissue samples to determine whether they are cancerous, and to 
determine the type of cancer present. Using this information the surgeon will determine 
which tissue should be removed from the patient. 

A typical turnaround time for preparing a frozen section is about fifteen minutes. 
During the tissue sample analysis session a pathologist will typically first rapidly scan the 
entire sample for gross features at a relatively low magnification, and identify particular 
sample regions of interest for more detailed study. The selected regions of interest are 
then observed at relatively high magnifications. It is typical for a pathologist to observe 
many separate regions at a number of different magnifications during an analysis session. 
The length of time required by the pathologist to complete this procedure and provide a 
diagnosis often about five to seven minutes. 

During diagnostic sessions pathologists will often observe a given specimen 
region at a number of different focal planes. The need for these range of focus 
observations is due at least in part to the fact that the specimen being imaged has depth 
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(i.e., is three-dimensional). Portions of the specimens at different depths must therefore 
be imaged at different focal planes. 

Large hospitals and universities often maintain an on-site clinical pathology 
laboratory and staff of pathologists to provide these services on demand. Since the 
diagnoses can be used to guide procedures to completion during a single surgery, the 
immediate access to the pathologist's expertise during surgery can provide s.gruficant 
benefits in terms of both economic and recuperative aspects of healthcare delivery. 

Smaller and outlying hospitals often rely on periodic visits from "circuit-ndmg' 
patho.og.sts that provide scheduled service to a group of hospitals. This commuting 
arrangement can be inefficient, since certain types of surgeries must be scheduled to 
coincide with the pathologist's visit- Travel time can also be an inefficient use of the 
pathologist's time. Furthermore, if routine or emergency surgical procedures being 
performed when the pathologist is not scheduled suddenly require a patho.og.st's 
expertise, the tissue sample must be shipped to a remote .aboratory for diagnos.s. The 
patient may then have to undergo surgery yet another time after the patho.ogica. diagnos.s 
has been completed. These procedures can result in increased costs and reduced 
effectiveness of healthcare delivery. 

A known solution to the problems associated with the lack of timely on-s.te 
access to the expertise of pathologists and other medical personnel i s the application of 
te.ecornmunications technology, also known as telemedicine. Te.epathology imagmg 
systems a type of remotely-contro.led imaging systems which use communicat.on 
technology to enable the remote observation of medical specimens, are known, and 
generally fall into one of two categories. So-called static telepatho.ogy systems make use 
of a trained pathologist and a laboratory having a microscope with digital electron* 
waging capabilities. Systems of this type are disclosed generally in the Weinstein et a., 
anil Lons-Dislance Diagnosis, American JO umal of Clin.ca, Pathology. 
Vol 91 pp S39-S42.1989. A clinician or other "sender" prepares the frozen sample 
tissue specimen, analyzes the specimen through the microscope, and identifies a number 
of specimen regions that appear to be of interest. Digital images of the 
interest are then generated, and electronically transferred to another site for analys, and 
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diagnosis by a pathologist. The pathologist can also communicate with the sender (e.g.. 
by telephone) during these procedures, and request images of specific sample regions. 

Dynamic systems such as those disclosed in the Weinstein et al. U.S. Patent 
5,216,596 make use of a trained clinician and a laboratory having a microscope with a 
conventional analog video camera. "Live" images of the specimen sample produced by 
the video camera are transmitted to a television monitor using conventional NTSC or 
PAL analog video signal protocols, or compressed and transmitted using well-known 
digital video conferencing technologies for transmission to remote sites. 

Since the operator has remote control over the microscope focus function in 
systems such as those disclosed in the Weinstein et al. patent, he or she can observe a 
number of different focal planes of the remotely-located specimen. Other remotely- 
controlled microscope systems, however, such as that described in the above-identified 
related application entitled "Digital Telepathology Imaging System" make use of 
conventional automatic focus systems on the remote microscope. Each time a new image 
region is imaged, or the magnification changed, the automatic focus system is actuated to 
focus the microscope. Digital data representative of a still image is then transmitted to the 
pathologist for observation. Since systems of this type do not provide pathologists with 
direct access to the focal plane adjustment of the microscope, the pathologists are unable 
to remotely observe different focal planes of the image. 

Known technology for image and video transmission and virtual environment 
rendering typically allocates computational and transmission resources which vary based 
on image content, interframe motion or scene complexity. Generally, the delivery of 
imagery with detailed content requires more encoding volume or computational effort 
(i.e., bandwidth) than imagery which has little detail or has predominately lowpass 
characteristics. 

For the transmission of discretized real-world imagery, the conventional (e.g., 
open-loop or machine-based) approach to determining which portions of an image 
sequence require extra bandwidth relies on a decomposition or blockwise analysis of the 
image sequence at the transmitter. Transmission and computational resources are 
thereby expended to decompose and prioritize an image sequence in terms of frequency 
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content (equivalent*, correlation) and/or mot.cn of image content between consecutive 
frames. 

During the use of remotely-controlled imaging systems, certain port.ons of an 
imag e under observation may be of higher interest than others. In telepathology, for 
example if an area of a transmitted image has a dominant color such as b.ue. .t ,s more 
lik ely to be an area of malignancy and therefore of greater interest to a pathology than 
other (e g non-blue) portions of the image. Applications of this type generally demand 
,oss.ess transmission, high spatial precision or color-space accuracy and relat.vely large 
computational resources. However, the prioritization of image data by conventual 
methods for encoding and transmission are generally not appropriate under these 
circumstances. 

It is evident that there is a need for improved remotely controlled imaging 
systems In particular, there is a need for improved bandwidth prioritization systems for 
telepathology and other remotely controlled imaging systems. There also is a need for a 
mechanism by which an operator can obtain images at a number of different discrete focal 
p.anes from a microscope or other imaging instrument at a remote location. It would be 
especially advantageous if such a remote focusing system were able to emulate 
conventional direct control over the focal plane. To be commercially viable and 
efficacious, the systems must be cost-effective and enable timely, high-quality healthcare 
delivery A telemedicine imaging system providing these benefits should be capable of 
generating diagnostic-quality images while enabling real-time image selection control. 
The system should also make efficient utilization of communication channel and 
computational resources while using lossless image transfer protocols 

rpTTTF nF-SCREPT ION OF TBLF, DRAWINGS 
Figure I is a diagrammatic illustration of a telepathology imaging system which 

includes bandwidth optimization and virtual focus systems in accordance with the present 

v 

invention. 

Figure 2 is an detailed diagrammatic illustration of one of the server systems 
shown in Figure 1 
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Figure 3 is an illustration of the graphic user interface (GUI) menu generated and 
displayed by the client system shown in Figure 1 . 

Figure 4 is an illustration of a GUI Open Session menu. 

Figure 5 is an illustration of a tiled slide overview specimen image. 

Figure 6 is an illustration of several cascaded specimen images with the GUI 
microscope control menu and zoom factor menu on the top image. 

Figure 7 is an illustration of several cascaded specimen images with the GUI 
image region selection reticle on the top image. 

Figure 8 is an illustration of GUI microscope control and resolution menus 
generated and displayed by the client system shown in Figure 1 . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
System Architecture and Overview 
A "virtual microscope" imaging system 10 for telepathology (Le., a remotely- 
controlled imaging system) which includes bandwidth optimization and virtual focus 
systems ih accordance with the present invention can be described generally with 
reference to Figure 1 . As shown, system 10 includes one or more (three are shown) 
"server" systems 12 which are interfaced to a "client" system 14 over a digital 
telecommunication channel 16. Client system 14 is located at a hospital or other local site 
of a pathologist, and includes a workstation 18, monitor 20 and operator-actuated user 
input 21 such as keyboard 22 and/or mouse 24. Each server system 12 will typically be 
located at a hospital or other remote surgical site which does not have a staff pathologist, 
and includes a workstation 26, monitor 28, microscope station 30 and keyboard or other 
user input (not shown). During surgical procedures being performed at the remote site of 
a server system 12, a technician or other clinician will prepare slides of frozen sample or 
other tissue specimens and position the specimen slides on microscope station 30. A 
pathologist or other clinician at the local site of client system 14 remotely controls the 
operation of the server system 12 through the use a graphical user interface (GUI) 
displayed on monitor 20 and the operator-actuated user input 21 In response to digital 
server system control commands received from the client system 1 4 over the 
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Although not shown, the microscope 3 1 also includes a conventional slide illumination 
light source and actuator-driven neutral density filter for controlling the specimen 
illumination level. 

A high-resolution camera 42 generates true-color image data representative of the 
specimen images produced by the microscope. This image data is digitized by the 
workstation 26. The camera 42 and digitizing system in workstation 26 function as a 
digital imaging system. Prototypes of system 10 include a camera 42 having a base 
resolution of at least approximately 600 x 800 pixels, and a digitizing system capable of 
capturing 8-bit per pixel (bpp) per color band still images (for a total of 24 bpp color). 
Conventional imaging control parameters of camera 42 can be accessed and controlled. 

Microscope station 30 is interconnected to workstation 26 through one or more 
interfaces illustrated generally at 44. Prototypes of system 10, for example, include an 
analog interface for connecting camera 42 to the workstation 26 and its digitizing system, 
and RSt232 busses for interconnecting the stage drive 40, objective drive 38, automatic 
focus system and image illumination system to the workstation 26. Monitor 28 is 
interconnected to workstation 26 by bus 46. These systems are capable of acquiring a still 
image and displaying that image at full resolution oh the monitor 28 in less than about I 
second. 

Workstation 26 is a conventional programmable computer, and is programmed 
with server system control software to control the operation of microscope station 30 in 
response to digital server system control commands received from the client system 14. 
Control commands received from server system 14 include camera commands, specimen 
region commands, magnification commands, focus commands and illumination 
commands. The specimen region commands include information designating a specific or 
desired region of interest on the specimen slide, and in one embodiment include 
information designating coordinates on the specimen slide in terms of "stage units " In 
response to the receipt of specimen region commands, workstation 26 actuates stage 
drive 40 and moves stage 34 to position the selected region of the specimen slide under 
objective 36. The magnification commands include information designating the desired 
magnification at which the selected specimen region is to be imaged. In response to the 
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receip. of ^cation command, wo,«*ion 26 actors drive 3S and cause, me 
sel ec,ed objecrive 36 ro be used ,„ image me specimen region. In response ..camera 
Lnunands. — « genera.es specimen image dau represenrarive of a sb» ,m.ge of 
Z specrmen region b.ng imaged bv me m,r„seope 3 , . *s deseed above, n,s,mage 
data is digitized by the workstation 26. 

As noted above, microscope 3 1 includes automatic focus and spec.men s„de 
^nation contro, systems. In response to focus commands received from 
,4 workstation 26 initiates an automatic focus routine by the automate focus system of 
t he microscope 3 , . Workstation 26 also initiates an automatic focus routine each urne the 
unification is changed Workstation 26 also control the iHumination system of the 
rnicroscope 3 1 (e.g., the neutral density filter) to change the illumination level of the 
specimen slide in response to illumination commands received from the client system 14, 
and can vary the imaging parameters of camera 42. 

Prototypes of system 1 0 use conventional TCP/IP protocol (transport control 
pro toco,/internet protocol) for the transfer of the server system contro, commands and 
specimen image data. The TCP/IP protocol of the prototype system 10 is supported by 
the Windows Sockets application programming interface (API) which prov.de* 
handshaking, error reporting and associated functions, and is therefore compatible w,th 
.oca. area network (LAN) as well as LAN-over-broadband te.ecommunicat.ons 
architectures. 

Client system 14 can include a workstation 1 8 and monitor 20 s.m.lar to those of 
server system .2. Workstation .8 is programmed with client system contro, software and 
GUI software. The GUI software generates and displays a Wmdows™-format GUI on 
mO nitor20. Through the use of the GUI and user input 21 , the pathologist or other 
clinician can select the specimen regions to be imaged by the microscope stat.on 30 of a 
server system 12, and the desired magnification of the selected specimen region. Server 
system contro. commands, including the specimen region commands and magnificats 
commands designating the image selected by the pathologist, are generated by the Cent 
system contro, software and transmitted to the server system 12 over commurucat.on 
channel 16. The client system contro, software also processes the digital image data 
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received from the server system 12, and generates visual displays on monitor 20 of the 
associated specimen images represented by the data. 

Graphic User Interface And System Operation 
Figure 3 is an illustration of the GUI menu 50 generated by workstation 1 8 and 
displayed on monitor 20 at client system 14. The illustrated embodiment of menu 50 
includes a menu bar 52 and a toolbar 54. The pathologist operates system 10 by using 
keyboard 22 and/or mouse 24 in a conventional manner to select commands on menu bar 
52 and toolbar 54. As described below, other commands not graphically displayed on the 
GUI can be selected by clicking the left and right buttons (not separately shown) of the 
mouse 24. In addition to conventional Windows™ commands (e.g., Window and Help), 
menu bar 52 includes the system-specific commands System, Session and Microscope. 
Toolbar 54 includes a number of conventional Windows™ command buttons 55 - 58, 
microscope (e.g t stage drive) control buttons 59, and a new slide button 60. Buttons 55 
and 56 are format buttons for selecting tiled or cascaded specimen image displays, 
respectively. Arrange icon button 57 and information button 58 provide conventional 
Windows™ functions when selected. Get slide button 60 can be actuated by the 
pathologist to obtain a tiled slide overview image (described in greater detail below) when 
a new specimen slide has been positioned for imaging on the remote microscope station 
30. The tiled slide overview image can also be initiated by the technician at the server 
system 12. A listing of the commands and associated functions available through the 
selection of the System, Session, Microscope, Window and Help commands on menu bar 
52 follows. Many of the commands provide conventional Windows™-format functions, 
and are identified as "Standard" in the listing. 

Menu Bar Options 



System 

Preferences 



Display "user preference" options to set parameters such as the way new 
images are displayed, the width of reticle borders, the way that gamma 
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Save 



Save As 



Print 



Print Setup 



Exit 
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Standard 



Standard 



Standard 



Standard 



Standard 



Session 



Connect 
Gamma 
Correction 



Get Slide 

Remote 

Database 



Chat 



Submit 
Diagnosis 



Establish diagnostic session 
Perform gamma correction on an 
Preferences" menu 



Patient 
Infonnation 



with server system (remote microscope) site 



Retrieve overview of entire specimen ____ 

Establish session with existing remote database (as opposed to .un ote control 



of a microscope) 



Establish TCP/IP "chat" session 



with remote node to interact with remote 



user via keyboard 



Display form for pathologist to compete w th info spec.fic to this rtagnost.c 
session, includin E fields for diagnosis, confidence level, system performance, 
image quality, etc. then send completed form to microscope locafon to be 
included with "trajectory" and patient history. Ttus option finales the 
session 

Display summary information i 
entered by technician at microscope site 



Microscope 



Refocus 



Intensity 



Get Image 



Image 



Instruct remote 
retrieves another image) 



microscope to perform autofocus routine Automatically 



induct remote microscope to chan-gTTihunination of specunen 

density filter and/or came ra parameters 

RSri eve another copy o f the current .mage from rernote microscope 



via neutral 



Perform interactive 



ive adjustment of image brightness to remotely calibrate the 
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Calibrate 



microscope's camera settings 



Window 



Tile 


Standard 


Cascade 


Standard 


Arrange All 


Standard 


About 


Standard 



Help 



Contents 


Standard 


Search for Help 


Standard 


How to Use Help 


Standard 



Figure 4 is an illustration of a GUI open session menu displayed on monitor 20 
and used by the pathologist to initiate a remote specimen pbservation session. The open 
session menu will be presented to the pathologist upon the selection of the Connect 
command available through menu bar 52. As shown, the open session menu includes a 
list of server systems 12 set up for operation with the client system 14, and displays the 
then-current specimen slide illumination (intensity) and image magnification (the 
established "user preference" values). Workstation 18 initiates and establishes an 
operational communication interface with the server system 1 2 selected by the pathologist 
through the open session menu. 

The pathologist will typically begin the diagnosis of a specimen by observing a 
slide overview image 70 such as that shown in Figure 5. The slide overview image 70 is a 
relatively low magnification image of a relatively large portion of the specimen on the 
slide, and in one embodiment is an image of the entire specimen on the slide. In the 
embodiment shown, the slide overview image 70 is an assembly of separate and discrete 
specimen region images 72 into a tiled overview image of the entire specimen on the slide. 
The slide overview image 70 shown in Figure 5, for example, is formed from a 3 x 4 array 
of specimen region images 72. 
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Generation of the overview image 70 is controlled by the server system control 
software in workstation 26. In response to Get Slide commands (or Send Sbde 
commands initiated by the clinician at server system 12), the workstation 26 actuates 
objective drive 38 to select a relatively low magnification (e.g., 2x) objects 36 and 
initiates an automatic focus routine. Stage drive 40 and camera 42 are then actuated to 
sequentially obtain the adjacent specimen region images 72 The image data for the 
specimen region images 72 is processed by the server system to reduce the resolution of 
the images, and transmitted to the client system 14 where it is assembled and d.splayedas 
th e slide overview image 70. The image data for each of the specimen regron .mages 72 
can be cached in memory of the workstation 18 so the image can be redisplayed as the 

topmost image on monitor 20. 

As noted above, the generation of a slide overview image 70 can be .rut.ated at 
either the server system 12 or the client system 14. After positioning a new spec.men 
slide on microscope station 30, the clinician can, for example, initiate the generauon of a 
slide overview image 70 by selecting a Send Slide command through a grapfcc user 
interfaced user input (not separately shown) at the server system 12. Image data 
representative of the slide overview image 70 wil, then be transmitted to the client system 
,4 and displayed on monhor 20, thereby indicating to the pathologist the ava.lab.hry of 
the specimen slide for observation. If the image data has already been transmitted by the 
server system 12, the pathologist can also initiate the generation of a new s.ide oversew 
image 70 from the client system through use of the Get S.ide command button 60 on 
toolbar 54 or the Get Slide command available through menu bar 52. 

During observation of the slide overview image 70 the pathologist will typ.cally 
identify specimen regions that he or she would like to observe in greater detail. Using the 
GUI and user input 21 , the pathologist can select the specimen region of interest and the 
desiredmagnificationatwhichthespecimenregionistobeobserved. The approbate 
server system control commands are then generated by the client system control software 
and transmitted to the server system 1 2 to initiate the retrieval and display of the specmen 
region of interest image (i.e., a detail image). 
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Specimen regions of interest can, for example, be selected by positioning the GUI 
cursor over the image and clicking the right button on mouse 24. As shown in Figure 6, 
this command causes a GUI microscope control menu 80 to be generated and displayed 
on monitor 20. Available commands in the microscope control menu 80 include Zoom 
and Zoom Factor. When the Zoom command is selected through user input 21 , the GUI 
software generates and displays on the then-displayed specimen region image an indicator 
such as reticle 82 shown in Figure 7. Using the user input 21 the pathologist can then 
reposition the reticle 82 over the specimen region of interest on the image, and thereby 
select the specimen region for further observation. Returning to the microscope control 
menu 80, the pathologist can then select the Zoom Factor command and cause the zoom 
factor menu 84 (Figure 6) to be generated and displayed by the GUI software. The zoom 
factor menu 84 includes a number of discrete magnification level commands 
corresponding to the available magnification levels (e.g., objectives 36) on microscope 
station 30, as well as In and Out step commands. The In command causes the 
magnification to increase one available power level from the then-current magnification at 
the microscope station 30, while the Out command causes the magnification to decrease 
one available power level from the then-current magnification. By clicking the left button 
of mouse 24 after selecting the desired magnification and image region of interest in the 
manner described above, the pathologist will initiate the generation and transmission of 
the appropriate magnification and specimen region commands to retrieve the image. 

Using the client system 14 in the manner described above, the pathologist is able 
to relatively quickly observe images of many different specimen regions at different 
magnifications. As is evident from Figure 6, multiple images can be simultaneously 
displayed on monitor 20. The images can be displayed in a manner which enables the 
pathologist to easily identify the location of the specimen region image with respect to the 
image overview and with respect to all other images. The magnification of the image is 
also displayed. Workstation 26 automatically maintains a log or cache describing in 
chronological sequence the control commands transmitted to the server system 1 2 and the 
coordinates of the specimen region of the retrieved image. In addition to providing an 
audit trail, this information streamlines the image acquisition and transfer functions and 
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proves .he pamolops, w*h tarn— « feedback tegarding «- regtons of *« specimen 
which have beer, imaged. Each of the retrieved specimen in»ges can be s.o,ed by .he 
wortrstarion 26 for subsequent retrieval and observation. 

System ,0 offers a number of important advantages, especially «* 
to » -stattc" and rug-solution, diagnost^uality. color 

Z*. - he retrieved and displayed in re* rime The system « be efBcendy operated 
through the user-friendly graph* use, imerfbce. Commccfally available hacdwase can be 
us ed o implement the system. The network proroco, is also robust, scalable <wo, s on 
Lwdiffhremsiae channels,, feat »d rCarivd, secure The syssem allows pam^og. ts 
„ quickly provide highway diagnostic opinions to mulrip.e remote locauons. thereby 
J d „gefficie„,u s eofmei,,ime. Ac^r.te precise, real-dme conuo, of the remote 
,^„g system is achieved Tbe sy*em can be in.eg~.ed with electronic pattern record 
JL1 to include patient mfortnation and diagnostic reaulss. The audit tratls whtcb can 
be provided are also advantageous. 

Virtual Fto cus Function 
.maging system ,0 can be configured ,o include a focal plane adjustment sysrem 
wbieri effective* prov.de, a virtual focus capabiUty to the pathologist a, client *stem , ,4. 
Tbe virtual focus function the pathologist ,o sequentially dtsplay on momtor 20 

seriesof diff=re„tanddiscre,especimenregionimages.td,ofwnichareim.gesof.he 
L specmen region and „ she same rn.gnieca.io, bu, which are ra.cn a, . range o 
focal pLs on opposite sides of the ••,n-focus" focal plane ,o wbich the ob.ecr.v. ,s 
«J .by .he somatic focus w »em of me microscope 3. The speed a, wbtch tbe 
d.ffeten, foca, plan, specimen region images are p.esen.ed on moni.or 20 can be 
olllleo by .Lpa.ho.ogis. .brough theuseof theOU, andVor user input 2, to stmulate 
observation of.be specimen Umage under convenrio n- i manual 

The virtual focus function of system 10 can be selected oy in P 
, he use of the GU> and/or use, io,ertaee2, One embodiment, to, example, includes , 
D^nuc Focus command in ,he lis. of commands available under the Mtcosoope 
^11 on menu bar 52. ,n response ,o pa.bolog.s. s.lecrion of the Dymanuc Focus 
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command, workstation 1 8 generates and transmits to server system 1 2 a focus adjust 
command. Generation of the different focal plane specimen region images is controlled 
by the server system control software in workstation 26. In response to the receipt of the 
focus adjust command, workstation 26 actuates the automatic focus system of the 
microscope 3 1 and camera 42 to generate image data for several specimen region images 
taken at a range of different focal planes on both sides of the in-focus focal plane 
determined by the automatic focus system of the microscope 31. In one embodiment, for 
example, workstation 26 initiates the generation of three specimen region images at three 
different focal planes below the in-focus focal plane, a specimen image at the in-focus 
focal plane, and three specimen region images at three different focal planes above the in- 
focus focal plane. The selected "out-of-focus" focal planes are typically symmetrically 
located about the in-focus focal plane. The image data for the virtual focus specimen 
images is then transmitted to the client system 14. 

Upon receipt of the virtual focus specimen image data, the client system 1 4 wilJ 
initially cause one of the images (typically the in-focus image) to be displayed on monitor 
20. The GUI presented with the virtual focus images will also include a focus control 
element which can be selected or actuated by the pathologist through the use of user 
interface 21. In one embodiment, for example, the GUI will include a conventional 
Window™-type slider bar on an edge of the display (not shown). Using the mouse 24 the 
pathologist can click on the arrows (also not shown) at the opposite sides of the slider 
bar, or click and drag on the slider button, to cause specimen region images at "adjacent" 
focal planes to be sequentially displayed on the monitor 20. 

During diagnostic sessions pathologists will routinely observe a given specimen 
region at a number of different focal planes. The reason for these range of focus 
observations is due at least in part to the fact that the specimen being imaged has depth 
(i.e., is three-dimensional). Portions of the specimen at different depths must therefore be 
imaged at different focal planes. The virtual focus function of system 10 allows the system 
to closely emulate the manner by which a pathologist would analyze a specimen through 
the direct use of a conventional microscope. 
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Ronrtwidtb Optimization Function 

Svsten, ,0 also offers m *. cap»«y - ^ °< 

syslem 4 «r » coMr<)i ^ 80 gener , Kd ^ dMayed on 

j when th e Resolution command >s selected through tne use 

. „,„„ nd i ne ,o the available resolution levels (e.g., per p.xe 
con^s ^ Worse aep The Better con^nd cause, 

r 7 . . ~ - - — * — *- whi,e the 

Worse — eause^ » ..^.tt,***- 

resolution, the patnolog r .„ 0 „ se the control software at the 

r , so ,u„on conuoands to the server „ ^ „ th „ , he 

5P "~ I"u, 8 .He resolution o f the specimen image, generated and 
H b !^e, S ys,e m ,2 provides imponan, advances. .magea of specimen 
"""IZZZZZ -o Prolog,* can he generated and ft— a, 

1 ftdX «, e . revive* low spaftal and,or color space diaorfton, Lossless 
rcleuvely high hdeliry 0 . . ^ ^ aocuri ,, e 

- H * M ^:7ZToZ™ o, .wer priori., on the other hand. - he 
diagnost.cop.mons. images otr g H >h reauire less bandwidth from the 

usefulness of the system 1 0. transmitt ed and contain subregions 



-16- 



WO 99/13360 



PCT/US98/I8852 



for diagnostic confidence can be transmitted incrementally, for that subregion only. For 
example, the pathologist can be observing a full-screen, relatively low resolution image 
transmitted to client system 14 (e.g., through use of a Zoom command); If the image is 
largely uninteresting, but a relatively small subregion which could be important is 
identified, the pathologist can select the Resolution command in the manner described 
above. In response to the selection of the Resolution command, the GUI software 
generates and displays a resolution indicator such as a resolution reticle (not shown), 
which can be similar to the reticle 82 described above with respect to the Zoom 
command. The resolution reticle or other indicator can be positioned over the image 
subregion of interest using the GUI and user input 21 in a manner similar to that described 
above for manipulating Zoom command reticle 82. 

After the resolution reticle is positioned, the pathologist clicks the left button on 
mouse 24 to initiate the generation and transmission of a resolution command to the 
server system 12. The server system 12 has already generated the digital image data at 
2 v full resolution (e.g., 24 bpp) for the entire image region being displayed at relatively low 
? resolution on monitor 20, and "degraded" this image data to produce the previously 
transmitted relatively low resolution version. Server system 12 also includes a stored 
record identifying the image data previously transmitted for the relatively low resolution 
image. The server system 12 therefore transmits only the additional image data required 
to augment the already-transmitted image subregion with an incremental improvement to 
obtain the desired resolution. These Resolution command procedures can be repeated on 
the same (or overlapping) image subregions until the "incremental" image data 
transmissions have completed the total available resolution (e.g., 24 bpp) for the selected 
image subregion. When used in this manner, the Resolution command effectively 
provides a function similar to the Zoom command. 

Although the present invention has been described with reference to preferred 
embodiments, those skilled in the art will recognize that changes can be made in form and 
detail without departing from the spirit and scope of the invention. In particular, although 
described as a telepathology system, the invention can be used in other remotely- 
controlled microscope applications. 
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WHAT IS CLAIMED IS: 

, A digital imaging system for enabiing a person at a .oca! site to observe 

and analyze images received in digital form from remote site, compris.ng: 
a server system at the remote site, including". 

ilge data means for providing digital image data representee of , mages, and 
a workstation interconnected to the image data means and includmg: 

a communication channel interface port adapted to be interfaced to a 

digital data communication channel over which the digital image 
data and server system control commands are transmuted 
between the local and remote sites; and 
ima ge output means responsive to resolution commands for outputung 
the digital image data representative of images at selected 
resolutions; and 
a client system at the local site, including: 
a monitor; 

an operator-actuated user interface; and . , 

a workstation interconnected tothe monitor and operator-actuated user .nterface 

and including: 

a communication channel interface port adapted to be interfaced to a 

digital data communication channel; 
imag e display means responsive to the digital image data received from 

the server system, for causing the monitor to visually d.splay the 

images; and 

resolution command generation means for generating resolution 

commands, representative of the resolution of the digital ,mage 
data to be transmitted to the client system by the server system, 
selected by the operator through use of the user interface. 
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2. The digital imaging system of claim ) wherein the image data means of 
the server system workstation includes memory for storing digital image data 
representative of the images. 



3. 



The digital imaging system of claim 2 wherein: 



the memory for storing digital image data representative of the images stores 

image data at a first resolution; and 
the resolution command generation means generates resolution commands, 

representative of the first resolution and at least a second resolution which 

is less than the first resolution, selected by the operator through use of the 

user interface. 

4. The digital imaging system of claim 1 wherein the workstation further 
includes graphic user interface display means for causing the monitor to display a graphic 
i user interface enabling a person using the operator-actuated interface to control the server 
S' system , including selecting the resolution of the digital image data to be transmitted 




5. The digital imaging system of claim 4 wherein: 



the graphic user interface display means of the workstation further includes means 
for causing the monitor to display a graphic user interface enabling an 
operator using the operator-actuated user interface to select a specimen 
region of interest; and 



the resolution command generation means includes means for generating 

commands representative of the specimen region of interest and resolution 
of the digital image data selected by the operator through use of the 
graphic user interface display and the operator-actuated user interface. 



6. The digital imaging system of claim 4 wherein: 

the graphic user interface display means of the client system workstation further 
includes means for causing the monitor to display a resolution menu in 
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response to clinician selection of a resolution command through use of the 
operator-actuated user interface; and 
the resolution command generation means of the client system workstation 
includes means for generating resolution commands in response to 
clinician selection of a desired resolution from the resolution menu 
through use of the operator-actuated user interface. 

7 The telemedicine imaging system of claim 6 wherein the resolution menu 
inCudes a list of resolution level commands representative of , mage data resolutions 
available from the server system. 

g The telemedicine imaging system of Cm 7 wherein the resolut.on men. 

includes step resolution level commands representative of resolut.on increases and 
decreases to a next available resolution. 

9 The telemedicine imaging system of claim 4 wherein: 
the graphic user interface display means of the client system workstation includes 
means for causing the monitor to display a resolution region indicator on 
the specimen image in response to clinician selection of a resolut.on 
indicator command through use of the operator-actuated user interface, 
and wherein the indicator can be manipulated by the clinician through use 
of the operator-actuated user interface to designate a region of the .mage 
for a resolution change; 
tne command generation means of the diem system workstation includes means 
for generating resolution commands representative of the selected 
specimen image resolution for the designated region of the image; and 
tne workstation of the server system includes resolution control means 

the specimen image data outputted by the image output means to be 
representative of the selected specimen image resolution for the 
designated region of the image. 
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10. The digital imaging system of claim 1 wherein: 

the server system further includes an imaging instrument having a focus system, 
for imaging an object; 

the image data means of the server system includes a digital imaging system for 

providing digital image data representative of the images produced by the 
imaging instrument; 

the workstation of the server system is interconnected to the focus system and 
digital imaging system, and further includes focus system control means, 
responsive to dynamic focus commands, for controlling the focus system 
and causing the imaging instrument to image the object at a plurality of 
focal planes, wherein the image output means outputs digital image data 
representative of the focal plane images produced by the instrument; 

the image display means of the client system workstation causes the monitor to 
visually display the plurality of focal plane images; and 

the client system workstation further includes dynamic focus command generation 
:fe means for generating dynamic focus commands in response to actuation 

of the user interface. 

v 11 The digital imaging system of claim 10 wherein the focus control means 

of the server system workstation causes the instrument focus system to image the object 
at an in-focus plane, at least one focal plane on a first side of the in-focus focal plane, and 
at least one focal plane on a second side of the in-focus focal plane/ in response to the 
dynamic focus commands. 

12. The digital imaging system of claim 1 1 wherein the client system 
workstation further includes graphic user interface display means for causing the monitor 
to display a graphic user interface enabling a person using the operator-actuated user 
interface to select focal plane images for display. 
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13. A remotely-controlled digital imaging system for enabling an operator at a 
local site to observe images produced by an instrument at a remote site, including, 
a server system at a remote site, including: 

an imaging instrument having a focus system, for imaging an object, 

a digital imaging system for providing digital image data representative of the 

images produced by the imaging instrument; and 
a workstation interconnected to the focus system and digital imaging system, and 
having a communication channel interface port adapted to be interfaced to 
a digital data communication channel over which the digital image data 
and server system control commands, including dynamic focus 
commands, are transmitted between the local and remote sites, the 
workstation including: 

focus system control means, responsive to dynamic focus commands, for 
controlling the focus system and causing the imaging instrument 
to image the object at a plurality of focal planes , and 

image output means for outputting digital image data representative of the 
focal plane images produced by the instrument at the plurality of 

focal planes; and 
a client system at a local site, including: 
a monitor; 

an operator-actuated user interface; and 

a workstation interconnected to the monitor and operator-actuated user interface, 
and having a communication channel interface port adapted to be 
interfaced to the digital data communication channel, the workstation 
including: 

image display means responsive to the digital image data received from 
the server system, for causing the monitor to visually display the 
plurality of focal plane object images; and 

dynamic focus command generation means for generating dynamic focus 
commands in response to actuation of the user interface 
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] 4. The digital imaging system of claim 13 wherein the focus system control 
means of the server system workstation causes the instalment focus system to image the 
object at an in-focus focal plane, at least one focal plane on a first side of the in- focus 
focal plane, and at least one focal plane on a second side of the in-focus focal plane, in 
response to the dynamic focus commands. 

1 5 The digital imaging system of claim 1 4 wherein the client system 
workstation further includes dynamic focus display control means responsive to the 
operator-actuated user interface, for causing the monitor to visually display the plurality 
of focal plane images in response to actuation of the user interface. 

16. The digital imaging system of claim 15 wherein the dynamic focus display 
control means includes graphic user interface display means for causing the monitor to 
display a graphic user interface enabling a person using the operator-actuated user 
interface to select focal plane images for display. 

1 7. The digital imaging system of claim 16 wherein the graphic user interface 
display means includes means for causing the monitor to display a graphic user interface 
enabling a person using the operator-actuated user interface to sequentially display the 
focal plane images. 

1 8. The digital imaging system of claim 1 7 wherein the graphic user interface 
display means includes means for causing the monitor to display a slider bar enabling a 
person using the operator-actuated user interface to sequentially display the focal plane 
images. 

1 9. The digital imaging system of claim 1 7 wherein the focus system of the 
imaging instrument includes an automatic focus control system. 
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20. The digital imaging system of claim 1 9 wherein the imaging instrument 
includes a microscope. 

21 The digital imaging system of claim 13 wherein the client system 
workstation further includes graphic user interface display means for causing the monitor 
to display a graphic user interface enabling a person using the operator-actuated user 
interface to select focal plane images for display. 

22 The digital imaging system of claim 21 wherein the graphic user interface 
display means includes means for causing the monitor to display a graphic user interface 
enabhng a person using the operator-actuated user interface to sequentially display the 
focal plane images. 

23 The digital imaging system of claim 1 3 wherein: 

the client system workstation further includes graphic user interface display means 
for causing the monitor to display a menu having a dynanuc focus 
command; and 

the dynamic focus command generation means includes means for generating 

dynamic focus commands in response to selection of the dynamic focus 
command from the menu through use of the user interface. 
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